2021-04-30 04:39

Contents of config.yml

#shrinkBatchSources: 30
batchSamples: 3
warmupIterations: 3
benchmarkIterations: 3
jsglr2variants:
  - standard
  - elkhound
  - incremental
languages:
  - id: java
    name: Java
    extension: java
    parseTable:
      repo: https://github.com/metaborg/java-front.git
      subDir: lang.java
    sources:
      incremental:
        - id: apache-commons-lang-stringutils
          name: StringUtils
          repo: https://github.com/apache/commons-lang.git
          files:
            - src/main/java/org/apache/commons/lang3/StringUtils.java
          versions: 3 # 16
        - id: gson
          repo: https://github.com/google/gson.git
          versions: 3 # 16
        - id: slf4j
          repo: https://github.com/qos-ch/slf4j.git
          versions: 3 # 16
  - id: webdsl
    name: WebDSL
    extension: app
    parseTable:
      file: ../parsetables/WebDSL.tbl
      subDir: webdslstatix
    sources:
      incremental:
        - id: webdsl-yellowgrass-incremental
          name: YellowGrass
          repo: https://github.com/webdsl/yellowgrass
          fetchOptions:
            - '--depth=200'
          versions: 3 # 16
        - id: webdsl-elib-utils
          name: elib-utils
          repo: https://github.com/webdsl/elib-utils
          versions: 3 # 16
  - id: sdf3
    name: SDF3
    extension: sdf3
    parseTable:
      repo: https://github.com/metaborg/sdf.git
      subDir: org.metaborg.meta.lang.template
    sources:
      incremental:
        - id: nabl
          name: NaBL
          repo: https://github.com/metaborg/nabl
          versions: 3 # 16
        - id: dynsem
          name: DynSem
          repo: https://github.com/metaborg/dynsem
          versions: 3 # 16
        - id: flowspec
          name: FlowSpec
          repo: https://github.com/metaborg/flowspec
          versions: 3 # 16
        - id: webdsl
          name: WebDSL
          repo: https://github.com/webdsl/webdsl-statix.git
          versions: 3 # 16
        - id: java
          name: Java
          repo: https://github.com/metaborg/java-front.git
          versions: 3 # 16

Iterations: 3/3

Spoofax version: master
JSGLR version: reuse-mess-5
SDF version: develop/jsglr2

Language	Parse Nodes			Character Nodes Count
Language	Count	Ambiguous	Irreusable	Character Nodes Count
Average	595627	0.36%	26.53%	333027
Java	1443909	0.00%	18.92%	849158
WebDSL	246661	0.06%	18.79%	99696
SDF3	96311	1.01%	41.88%	50226

Language	Parse Nodes			Shift		Breakdown
Language	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	21547	98.59%	1.12%	1528	2473	1.32%	58.07%	0.00%	13.62%	28.32%
Java	49570	98.10%	1.67%	3636	5433	1.84%	55.42%	0.00%	2.53%	42.06%
WebDSL	6871	99.21%	0.48%	643	927	0.71%	50.50%	0.00%	28.94%	20.56%
SDF3	8200	98.45%	1.23%	305	1058	1.40%	68.29%	0.00%	9.38%	22.33%

Per Language

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	1443909	0.00%	18.92%	849158
StringUtils	571226	0.00%	15.07%	396935
gson	2305879	0.00%	23.22%	1267956
slf4j	1454623	0.00%	18.47%	882583

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	49570	98.10%	1.67%	3636	5433	1.84%	55.42%	0.00%	2.53%	42.06%
StringUtils	118384	94.71%	4.67%	8411	12466	5.14%	57.69%	0.00%	2.21%	40.11%
gson	8211	99.92%	0.07%	791	744	0.08%	57.45%	0.00%	1.92%	40.63%
slf4j	22116	99.66%	0.26%	1705	3090	0.30%	51.11%	0.00%	3.46%	45.43%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	571226	0 (0.00%)	86081 (15.07%)	396935

0	571555	0 (0.00%)	86079 (15.06%)	397077
1	570897	0 (0.00%)	86083 (15.08%)	396792
2	570913	0 (0.00%)	86059 (15.07%)	396796

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	118384	541016 (94.71%)	26702 (4.67%)	8411	12466	29376 (5.14%)	16889 (57.69%)	0 (0.00%)	706 (2.21%)	11781 (40.11%)
-> 0	1050282			0	397078
0 -> 1	146311	535024 (93.61%)	31438 (5.50%)	10174	14273	34963 (6.12%)	19811 (56.66%)	0 (0.00%)	1135 (3.25%)	14017 (40.09%)
1 -> 2	90457	547007 (95.82%)	21965 (3.85%)	6647	10658	23788 (4.17%)	13967 (58.71%)	0 (0.00%)	277 (1.16%)	9544 (40.12%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	2305879	0 (0.00%)	535339 (23.22%)	1267956

0	2305749	0 (0.00%)	535313 (23.22%)	1267874
1	2306009	0 (0.00%)	535365 (23.22%)	1268038
2	2306176	0 (0.00%)	535403 (23.22%)	1268122

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	8211	2304031 (99.92%)	1579 (0.07%)	791	744	1851 (0.08%)	1062 (57.45%)	0 (0.00%)	36 (1.92%)	753 (40.63%)
-> 0	6379840			0	1268079
0 -> 1	8461	2303864 (99.92%)	1668 (0.07%)	782	805	1887 (0.08%)	1027 (54.43%)	0 (0.00%)	37 (1.96%)	823 (43.61%)
1 -> 2	7961	2304197 (99.92%)	1489 (0.06%)	800	682	1814 (0.08%)	1097 (60.47%)	0 (0.00%)	34 (1.87%)	683 (37.65%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	1454623	0 (0.00%)	268693 (18.47%)	882583

0	1453298	0 (0.00%)	268522 (18.48%)	881618
1	1455947	0 (0.00%)	268864 (18.47%)	883547
2	1455688	0 (0.00%)	268796 (18.47%)	883490

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	22116	1449748 (99.66%)	3790 (0.26%)	1705	3090	4343 (0.30%)	2220 (51.11%)	0 (0.00%)	151 (3.46%)	1973 (45.43%)
-> 0	3421848			0	881857
0 -> 1	24371	1448613 (99.68%)	3782 (0.26%)	1691	3970	4301 (0.30%)	2208 (51.34%)	0 (0.00%)	91 (2.12%)	2002 (46.55%)
1 -> 2	19860	1450882 (99.65%)	3798 (0.26%)	1718	2210	4385 (0.30%)	2231 (50.88%)	0 (0.00%)	211 (4.81%)	1943 (44.31%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	246661	0.06%	18.79%	99696
YellowGrass	391440	0.07%	17.81%	159241
elib-utils	101881	0.05%	19.78%	40151

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	6871	99.21%	0.48%	643	927	0.71%	50.50%	0.00%	28.94%	20.56%
YellowGrass	10562	99.28%	0.61%	853	1308	0.71%	61.17%	0.00%	11.09%	27.74%
elib-utils	3180	99.14%	0.35%	432	545	0.70%	39.83%	0.00%	46.79%	13.38%

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	391440	272 (0.07%)	69698 (17.81%)	159241

0	391488	272 (0.07%)	69698 (17.80%)	159255
1	391392	272 (0.07%)	69698 (17.81%)	159227
2	393245	272 (0.07%)	70134 (17.83%)	159948

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	10562	388611 (99.28%)	2375 (0.61%)	853	1308	2791 (0.71%)	1616 (61.17%)	0 (0.00%)	331 (11.09%)	844 (27.74%)
-> 0	684076			0	159307
0 -> 1	8082	388824 (99.32%)	2312 (0.59%)	177	1012	2497 (0.64%)	2302 (92.19%)	0 (0.00%)	98 (3.92%)	97 (3.88%)
1 -> 2	13041	388398 (99.24%)	2437 (0.62%)	1529	1604	3084 (0.79%)	930 (30.16%)	0 (0.00%)	563 (18.26%)	1591 (51.59%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	101881	48 (0.05%)	20154 (19.78%)	40151

0	101002	48 (0.05%)	20046 (19.85%)	39821
1	102759	48 (0.05%)	20262 (19.72%)	40480
2	103029	48 (0.05%)	20322 (19.72%)	40589

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	3180	101015 (99.14%)	351 (0.35%)	432	545	713 (0.70%)	373 (39.83%)	0 (0.00%)	306 (46.79%)	35 (13.38%)
-> 0	181055			0	39838
0 -> 1	5202	99540 (98.55%)	572 (0.57%)	748	910	1183 (1.17%)	694 (58.66%)	0 (0.00%)	484 (40.91%)	5 (0.42%)
1 -> 2	1158	102489 (99.74%)	129 (0.13%)	115	179	243 (0.24%)	51 (20.99%)	0 (0.00%)	128 (52.67%)	64 (26.34%)

Source	Parse Nodes			Character Nodes Count
Source	Count	Ambiguous	Irreusable	Character Nodes Count
Average	96311	1.01%	41.88%	50226
NaBL	196093	0.88%	39.72%	99420
DynSem	21531	1.22%	40.38%	10138
FlowSpec	27218	1.06%	47.66%	13760
WebDSL	162860	1.14%	41.38%	86161
Java	73854	0.76%	40.24%	41650

Source	Parse Nodes			Shift		Breakdown
Source	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average	8200	98.45%	1.23%	305	1058	1.40%	68.29%	0.00%	9.38%	22.33%
NaBL	27501	97.51%	1.63%	932	3373	1.77%	70.97%	0.00%	3.11%	25.92%
DynSem	2764	97.63%	1.99%	142	331	2.36%	61.28%	0.00%	9.40%	29.32%
FlowSpec	3640	98.32%	1.42%	86	507	1.66%	69.03%	0.00%	15.03%	15.94%
WebDSL	6031	99.13%	0.81%	245	959	0.86%	79.07%	0.00%	3.28%	17.65%
Java	1065	99.65%	0.32%	120	119	0.35%	61.11%	0.00%	16.06%	22.83%

Sources

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	196093	1717 (0.88%)	77892 (39.72%)	99420

0	194617	1717 (0.88%)	77231 (39.68%)	98731
1	197569	1717 (0.87%)	78553 (39.76%)	100108
2	197573	1717 (0.87%)	78551 (39.76%)	100110

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	27501	191227 (97.51%)	3188 (1.63%)	932	3373	3462 (1.77%)	2451 (70.97%)	0 (0.00%)	113 (3.11%)	898 (25.92%)
-> 0	522249			0	98858
0 -> 1	36824	188008 (96.60%)	3625 (1.86%)	1064	4963	3945 (2.03%)	2750 (69.71%)	0 (0.00%)	166 (4.21%)	1029 (26.08%)
1 -> 2	18177	194446 (98.42%)	2751 (1.39%)	799	1782	2978 (1.51%)	2151 (72.23%)	0 (0.00%)	60 (2.01%)	767 (25.76%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	21531	263 (1.22%)	8694 (40.38%)	10138

0	21312	259 (1.22%)	8602 (40.36%)	10027
1	21750	267 (1.23%)	8785 (40.39%)	10248
2	21750	267 (1.23%)	8785 (40.39%)	10248

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	2764	21022 (97.63%)	427 (1.99%)	142	331	508 (2.36%)	303 (61.28%)	0 (0.00%)	50 (9.40%)	155 (29.32%)
-> 0	56142			0	10031
0 -> 1	3628	20700 (97.13%)	518 (2.43%)	188	455	616 (2.89%)	332 (53.90%)	0 (0.00%)	71 (11.53%)	213 (34.58%)
1 -> 2	1899	21344 (98.13%)	335 (1.54%)	95	206	399 (1.83%)	274 (68.67%)	0 (0.00%)	29 (7.27%)	96 (24.06%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	27218	289 (1.06%)	12973 (47.66%)	13760

0	26820	283 (1.06%)	12790 (47.69%)	13540
1	27616	295 (1.07%)	13156 (47.64%)	13980
2	28023	295 (1.05%)	13267 (47.34%)	14154

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	3640	26763 (98.32%)	383 (1.42%)	86	507	450 (1.66%)	339 (69.03%)	0 (0.00%)	58 (15.03%)	54 (15.94%)
-> 0	77718			0	13560
0 -> 1	5315	26191 (97.65%)	559 (2.08%)	88	706	641 (2.39%)	536 (83.62%)	0 (0.00%)	64 (9.98%)	41 (6.40%)
1 -> 2	1964	27334 (98.98%)	206 (0.75%)	84	307	259 (0.94%)	141 (54.44%)	0 (0.00%)	52 (20.08%)	66 (25.48%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	162860	1864 (1.14%)	67390 (41.38%)	86161

0	162878	1864 (1.14%)	67403 (41.38%)	86167
1	162841	1864 (1.14%)	67376 (41.38%)	86154
2	163063	1868 (1.15%)	67436 (41.36%)	86285

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	6031	161447 (99.13%)	1315 (0.81%)	245	959	1400 (0.86%)	1110 (79.07%)	0 (0.00%)	35 (3.28%)	255 (17.65%)
-> 0	424536			0	86193
0 -> 1	9723	160497 (98.54%)	2216 (1.36%)	398	1485	2353 (1.44%)	1869 (79.43%)	0 (0.00%)	49 (2.08%)	435 (18.49%)
1 -> 2	2338	162397 (99.73%)	413 (0.25%)	92	433	446 (0.27%)	351 (78.70%)	0 (0.00%)	20 (4.48%)	75 (16.82%)

Version	Parse Nodes			Character Nodes Count
Version	Count	Ambiguous	Irreusable	Character Nodes Count
Average (0..1)	73854	559 (0.76%)	29718 (40.24%)	41650

0	73857	559 (0.76%)	29718 (40.24%)	41651
1	73851	559 (0.76%)	29718 (40.24%)	41649
2	73852	559 (0.76%)	29718 (40.24%)	41649

Version	Parse Nodes			Shift		Breakdown
Version	Created	Reused	Rebuilt	Parse Node	Character Node	Count	Irreusable	No Actions	Temporary	Wrong State
Average (1..2)	1065	73596 (99.65%)	234 (0.32%)	120	119	258 (0.35%)	160 (61.11%)	0 (0.00%)	40 (16.06%)	58 (22.83%)
-> 0	197675			0	41712
0 -> 1	1270	73573 (99.62%)	249 (0.34%)	117	137	280 (0.38%)	204 (72.86%)	0 (0.00%)	28 (10.00%)	48 (17.14%)
1 -> 2	860	73618 (99.68%)	218 (0.30%)	123	100	235 (0.32%)	116 (49.36%)	0 (0.00%)	52 (22.13%)	67 (28.51%)